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ABSTRACT 


The robustness of control systems with respect to mode! uncertainty 
is considered using simple frequency domain criteria. Both old and new 
results are derived under a common framework in which the minimum singular 
value of the return difference transfer matrix is the key quantity. In 
particular the LQ and LQG robustness results are discussed. 



1, INTRODUCTION 


The importance of obtaining robustly stable feedback control systems 
has long been recognized by designers. Indeed, a principal reason for 
using feedback rather than open loop control is the presence of mode! 
uncertainties. Any model is at best an approximation of reality, and the 
relatively low order, linear, time-invariant models most often used for 
controller synthesis are bound to be rather crude approximations. 

More specifically, a given system mode! can usually be characterized 
as follows. There is a certain range of inputs typically bounded in amplitude 
and in rate of change for which the model gives a reasonable approximation 
to the system. Outside of this range, due to neglected nonlinearities and 
dynamic effects, the model and system may behave in grossly different ways. 
Unfortunately, this range of permissible inputs is rarely spelled out ex- 
plicitly along with the model, but is rather implicit in the technology that 
the model came from - there is no "truth in modeling" law in systems theory, 
in classical frequency domain techniques for single-input, single- 
output (SISO) control system design, the robustness issue is naturally 
handled. These techniques employ various graphical means (e.g.. Bode, 
Nyquist, inverse-Nyquist, Nichols plots) of displaying the system model 
in terms of its frequency response. From these plots, it is automatic to 
determine by inspection the minimum change in the model frequency response 
that leads to instability. 

^See the fundamental work of Bode [6], and any good classical textbook, but 
especially [9]. 
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Commonly used measures of the closeness of a SI SO feedback system to 
instability are its gain and phase margins. The- margins are- defined with 
reference to Fig. 1.1. Here the nominal feedback system (with a = 1 ) is 
assumed stable. The positive phase margin is the smallest value of (|) greater 
than zero such that the system of Fig. 1.1 with a(ju) = e^*'^ is unstable. The 
negative phase margin is defined in an analogous fashion. The upward 
gain margin is the smallest value of a = constant > 1 for which the system 
is unstable (usually expressed in decibels with respect to a = +1), and the 
downward gain margin is similarly defined. The notions of gain and phase 
margins have gained such widespread acceptance that they are commonly 
incorporated into the specifications for a control system design. 

To give a concrete and explicit example, consider the military speci- 
fications on the design of flight control systems for piloted aircraft. Among 
other requirements, a feedback control systems must have certain gain and 
phase margins in order to be acceptable. To quote from the military speci- 
fications 

"Stability margins are required for FCS to allow for variations in 

system dynamics. Three basic types of variations exist: 

. Math modeling and data errors in defining the nominal system 
and plant. 

. Variations in dynamic characteristics caused by changes in 
environmental conditions, manufacturing tolerances, aging, 
wear, noncritical material failures,, and off-nominal power 
supplies. 

_ 

See the fundamental work of Bode [6], and any good classical textbook, 
but especially [9]. 
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Maintenance induced errors in calibration, installation and 
adjustment. " 

In would seem from the above quotation that the robustness issue is 
well-understood from the viewpoint of classical frequency domain techniques, 
at least for flight control systems. Indeed, this is the case, for single-loop 
systems . However, the situation is quite different for multiple-loop systems. 
To quote again from the military specifications: 

"in multiple-loop systems, variations shall be made with ail gain 
and phase values in the feedback paths held at nominal values 
•except for the path under investigation." 

The fundamental difficulty with this approach is that it fails to check the 
affect of simultaneous gain and phase variations in several paths. Of course, 
real-world model uncertainty cannot be expected to nicely confine itself 
to a single loop of the system! In fact, for a flight control system, the 
dominant variation is due to the change in control surface effectiveness with 
dynamic pressure, which manifests itself as a change in the gains of the 
transfer functions from control surface deflections to the response variables 
of interest. The dynamic pressure variation is due to changes in aircraft 
altitude and speed, and clearly affects all loops simultaneously. 

From this discussion, it is clear that a satisfactory notion of stability 
margins for a multivariable feedback system must be able to characterize 
the ability of the system to tolerate gain and phase variations in all its 
loops simultaneously. It is only very recently, in the context of studying 
the feedback properties of controllers derived using linear-quadratic 
Guassian (LQG) techniques, that an appropriate formulation has emerged. 

The purpose of this paper is to develop the ideas of this formulation, and 
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to derive in a relatively simple way the robustness properties of LQG 
controllers. 

The paper begins in Section II by developing a characterization of the 
robustness of a multivariable feedback system in terms of the minimum 
singular value of its return difference transfer function matrix. This 
quantity is a natural one to consider as it directly generalizes the classical 
notion of the distance of the Nyquist locus of a single-input feedback system 
to the critical (-1) point. The characterization is original, and is derived 
rather simply from arguments based on the multivariable Nyquist theorem. 
Multivariable gain, phase, and crossfeed margins are derived in terms of 
the minimum singular value. 

The development in Section II permits an efficient derivation of the 
robustness properties of LQ controllers in Section II since the Kalman 
frequency domain inequality provides a bound on the minimum singular value 
of an optimal return difference- transfer function matrix. The dependence of 
these robustness properties on the form of the control weighting matrix R 
is illustrated by introducing a counterexample of an LQ ( not LQG) regulator 
with vanishingly small gain margins. The robustness degradation associated 
with introducing a Kalman filter into a feedback system are briefly discussed, 
and robustness recovery procedures are mentioned. 

The paper closes in Section iV with a summary and discussion of the 
results of the paper. Also, since singular values are used throughout the 
paper, a brief discussion of them is given in the Appendix . 


Notation 
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(A,B,C) realization of linear system- specified by 
X' = Ax + Bu 
y = Cx 

G(s) loop-transfer matrix 

ifiQj^Cs) open-loop characterisitic polynomial 

closed-loop characteristic polynomial 

L(s] multiplicative perturbation of G(s) 

X(A) an eigenvalue of A 

H 

A complex conjugate transpose of A 

1 /2 H 

a{A) maximum singular value of A = X (A A) 

^ max 

o(A) minimum singular value of A = (A^A) 

— ^ ^ . mirr 

M number of clockwise encirclements of the point by the locus 

of f (sj as s traverses the closed contour 'g' in the complex 
plane in a clockwise sense. 

Dp^ Nyquist contour of radius R given in Fig, 2.2 with ^ -radius 

indentations. 

segment of Dj^ for which Re[s] £ 0. 

SISO single-input-single-output 

MIMO multiple-input-muitiple-output 

ORHP(CRHP) open (closed) right half plane 
OLHP(CLHP) open (closed] left half plane 
A > B A-B is positive definite 


A > B 


A-B is positive semi-definite 
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if and only if 

3 

there exists 


such that 


implies 

A 

defined as 

LQ 

linear-quadratic 

LQG 

linear-quadratic-gaussian 

KF 

Kalman filter 

z* 

complex conjugate of z 

V 

for all 
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!l. MULTIVARIABLE STABILITY MARGINS 

In this section we will develop the basic characterizations of the 
robustness of linear multivariable feedback systems, i.e., multivariable 
stability margins, to be used in the remainder of the paper. The feed- 
back system to be discussed is depicted in Fig. 2.1, where the loop 
transfer matrix G(s] is assumed to incorporate both the plant dynamics 
and any compensation employed, and has the state space realization 

G(s) = G(sl-A)“^B . (2. 1) 

The basic issue of concern is to characterize the robustness of the feedback 
system, i.e., the extent to which the elements of the loop transfer function 
matrix G(s) can vary from their nominal design values without compromising 
the stability of the system. The analysis is based on the multivariable 
Nyquist theorem. 


A . Multivariable Nyquist Theorem 

The multivariable Nyquist theorem is derived from the ceiationship 


det(l+G(s)) 


(s] 


C2.2) 


where 


(j>QL^s) = det(sl-A) (2.3) 

4)^^{s) = det(sl-A+BC) (2.4) 

and from the Principle of the Argument of complex variable theory. The 
following statement of the Nyquist theorem is a variation of a version given 
by Rosenbrock in [1]. 
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Theorem 2.1; The system of Fig. 2.1 is ciosed-ioop asymptotically stable 
{in the s.ense that has no CRHP zeroes) if and only if for ail R 

sufficiently large 

MO, det[l+G(s)L Dj^) = -P (2.5) 

or equivalently, 

M-h -Hdet[i+G(s)l, Dp,) = -P (2.6) 

where Dj^ is the contour of Fig. 2.2 which encloses ail CRHP zeroes of 
<J> 0 l(s) , P is the number of CRHP zeroes of 4 >qj_(s) and where for convenience 
we define,yf(fl, f(s), 'g’) = j when f(Sg) =fi, for some s^^ € 

Notice that no controllability or observability assumptions have been 
made. If [A,B,C] is a nonminimal realization then pole-zero cancellations 
will occur when G(s) is formed, eliminating uncontrollable or unobservable 
modes. The stability of these modes cannot be tested in terms of G(s) . How 
ever, by using the zeroes of 4 >q]_(s) instead of the poles of the loop transfer 
matrix G(s) , this version of the Nyquist theorem allows one to test for the 
internal stability of the closed-loop system. 

When compared with the classical Nyquist theorem for the SISO case, 
the multivariable Nyquist theorem is much more difficult to use, for two 
reasons. First, the dependence of det(l+G(s)) on the compensation implicit 
in G(s) is complicated, and cannot be easily depicted with a Nyquist, Bode 
or related plot. This fact has motivated a considerable amount of research 
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on synthesis methods, e.g., [2] - [5], which need not concern us here. 

Second, and this is the key observation, one cannot get a satisfactory notion 
of multivariable stability margins directly from the the multivariable Nyquist theorem. 
The following extremely simple example illustrates this fact. 


Example 2.1: 

Consider the linear system specified by 
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which is illustrated -in Fig. 2.3. 

If the feedback compensation 
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is used the ciosed-loop system is given by 
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The eigenvalues of this sytem are -2, -2 and therefore it is stable. The return 
difference matrix 1+G(s) is given by 
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(2.1i-)- 


and thus 

det(l+G(s))-1 = . (2-12) 

(s+1)^ 

2s+3 

The multivariable Nyquist diagram is just the usual Nyquist diagram of y 

(s+1)^ 

and is shown in Fig. 2.4. If this is interpreted as for a SISO system, one 
would conclude that the system has an infinite upward gain margin, a gain 
reduction margin of -1/3 and a phase margin of ±106°-margins indicative of 
a highly robust system. Note, however, that the Nyquist diagram does not 
depend on the value of ^s b^^ becomes large the closed-loop system is 

close to instability in the following sense, if the open-loop system of Fig. 2.3 
is perturbed slightly to obtain the system of Fig. 2.5, the closed-loop system 
obtained by negative identity feedback is unstable (as is easily verified) . 

This situation cannot be detected by inspection of the multivariable Nyquist 
theorem. ^ 

The difficulty we have uncoverned can be explained as follows. A 
multivariable system will not be robust to modeling errors if its return dif- 
ference transfer function matrix I+G(Jo)) is nearly singular at ' some frequency 
0 ) , since then a small change iq G(joj ) will make I+G(joj ) exactly singular. 

When this happens, det(I+G(ja)^)) = 0 and the number of encirclements counted 
in the multivariable Nyquist theorem changes. Unfortunately, the near singularity 

Vhe situation cannot be detected by classical, single-loop tests or by charac- 
teristic loci plots [5] either. 


1+G(s) = 


s+2 


s+1 

0 


12 


s+1 


s+2 
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of a matrix cannot always be detected in terms of its determinant. Instead, 
tests such as those developed in the remainder of this section must be em- 
ployed. 

B . Robustness Characterization 

From the above example, we can see that the problem of determining 

I 

characterizations of the robustness of a multivariable feedback system, i.e., 
its distance from instability, is of fundamental importance. The basic work 
in this area is due to Safonov [7], [8], who generalized an approach of 

Zames [10], [11]. Safonov's work heavily utilizes concepts of functional 
analysis, as is standard in the modern input-output formulation of stability 
theory \ However, in the finite dimensional iinear-time-invariant case con- 
sidered in this paper, powerful robustness characterization can be derived 
more simply in terms of the multivariable -Nyquist theorem. 

The feedback system under consideration in the following theorems is 
shown in Fig. 2.6, where G(s) again represents the loop-transfer matrix (open 
loop plant plus controller) as in Fig. 2,1 and L(s) is a multiplicative pertur- 
bation applied to G(s) to account for uncertainty in the open-loop plant model. 
We denote the perturbed system as G(s) given by 

G{s) = G(s)L(s) (2.13) 

which is assumed to have a state-space realization (A, B, C) , open-loop 
characteristic polynomial ‘J’Q|_ts) given by 

$-|^^(s) = det(s i-A) (2.14) 

and similarly a closed-loop characteristic polynomial ^^j^(s) given by 
^See, e,g,, [12] or [13] 
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iy 


= det(sl-A+BC) . 


(2.15) 


All the results of this section are based on the following theorem. 

Theorem 2.2: The polynomial (2.14) has no CRHP zeroes If the 

following conditions hold: 


(a) have the same number of CRHP zeroes, (2.16) 


(b) if ° = 0' 




(2.17) 


(c) CRHP zeroes. 


(2.18) 


(d) det[l+(l-€)C(s) + G G(s)] ^0, s G for all R 
sufficiently large and for all G on the interval 
[ 0 , 1 ]. 


(2.19) 


Proof: Appendix 

The basic idea behind this theorem is that of continuously deforming 
the Nyquist diagram of the nominal system G(s) to one corresponding to the 
Nyquist diagram of the perturbed system G(s) without changing the number 
of encirclements of the critical point- if this can be done and the number of 
encirclements of the critical point required for G(s) and G(s) are the same, 
then no CRHP zeroes of ^^;;j_(s) will result from this perturbation. Imbedding 
arguments of this type have been previously used, implicitly by Rosenbrock 
[1] and explicitly by Doyle [14], in connection with linear systems and in the 
more general context of nonlinear or multidimensional systems by DeCarlo, Saeks 
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and Murray [15] - [17], utilizing homotopy theory from algebraic topology. 

The significance of Theorem 2.2 is that various multivariable robustness 
characterizations can be stated in terms of conditions that guarantee that 
(2.19) is satisfied, in checking condition (2.19), it is unnecessary to con- 
sider all s £ because a[G(s)]] and a[S(s]] -> 0 as [s|-»oo- This is due 
to the assumption that their respective state-space realizations have no direct 
feedthrough from input to output so that there are more poles than zeroes 
in both G(s) and G(s) . It is therefore convenient to define as 

= [sis € and Re(s) < 0} (2.20) 

which is the only part oT the Nyquist contour on which (2.19) need be verified. 
Using this simplification, one characterization that guarantees (2.19) is based 
on the return difference matrix 1+G(s). This result is new, although related 
to conicity conditions discussed by Zames [10] and Safonov [7], and is 
fundamental to the derivation of the LQ state-feedback and LQG stability mar- 
gins. 

We emphasize that the following theorem is distinct from the main results 
in [14], [18]. These papers work with o(I+G ^(s)) (for a multiplicative repre- 
sentation of model uncertainty) , which is complementary to the quantity 
o(l+G(s)), which measures the distance between the Nyquist locus and the 
critical (-1) point in. the SISO case. Moreover, these papers work with o(L(s)-I) 
(in our notation) rather than o{L ^(s) -1). As a consequence, it is not 
possible to derive the gain and phase margin properties of LQ and LQG con- 
trollers using the results stated in [14], [18]. 
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Theorem 2,3 : The polynomial has no CRHP zeroes if the following 

conditions hold for all R sufficiently large-: 

(a) conditions (2.16) - (2.18) of Theorem 2.2 hold (2.21) 

(b) a(L“'‘(s)-l) < a4a(l4-G{s)), s £ (2.22) 

(c) any one of the following is satisfied at each s £ 

R 

(i) a<1 (2.23) 

(ii) L^(s)+L(s)>0 (2.24) 

(iii) 2fo:^-1) c7^(L(s)-I) > aV(L(s) +L^(s) - 21) (2,25) 


An analytical proof of Theorem 2,3 is provided in the Appendix. It is, 
however, instructive to given a simple graphical proof for the SISO case. 

By the embedding argument of Theorem 2.2, our nominal feedback system 
and its perturbed version will have the same number of encirclements of the 
critical (-1) point if we can continuously deform the nominal into the perturbed 
Nyquist locus. This will be the case if, for 0 < £ < 1, we have 

1 + [£ il(s) + (1-£ )]g(s) 0, s£flp, (2.26) 

or equivalently 

~ VTsT s £fij^ . (2.27) 


In the scalar case, the inequality 
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|1+g(s)| > a / (2.28) 

shown in Fig. 2.7 (d) , simply says that g(s) lies outside a circle of radius 

a about the -1 point. Consequently, when 1+g(s) =a, -1/g(s) will lie on 

a 1 

a circle of radius — (infinite when a=1) centered at j- as illustrated 

a -1 1-a 

in Figs. 2.7 (a), (b) and (c) for various a. Then, the allowable values of £(s) 

are those that can be connected to the +1 point by a straight line not inter- 
secting the circle of possible boundary values of - . 

We emphasize that a varies as a function of s so that Fig. 2.7 only 

represents the situation at a single (complex) frequency. Similarly, the 
condition (2.22) of Theorem 2.3 must be tested for all s G This is most 

readily accomplished by computing and plotting a(L \s)-l) and a(l+G(s)). 

The situation is roughly analagous to looking at a magnitude Bode plot. Com- 
putational techniques are discussed in [19]. 

■To show that condition (2.22), in Theorem 2.3, alone is not enough to 
guarantee stability of the perturbed closed-loop system of Fig. 2.6 a simple 
counterexample is given. 

Example 2.2: Let 



(2.29) 

^ (s) = s+1 

(2.30) 

OL 


= s+10 

(2.31) 

=lrf 

(2.32) 

?oJs) = (s+1)^ 

(2.33) 


then 
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^Cjco)-1| < n+g(ju)l (2.34) 

but 

= s^+11s - 8 (2.35) 

has a CRHP zero. 

From Theorem 2.3, it is dear that the quantity a(I+G(s)) is a multi- 
variable stability margin for the feedback system at the complex frequency 
s. However, this quantity is unconventional, and possibly somewhat difficult 
to interpret. Therefore, we will explore further some of the consequences of 
the theorem. 

Note from Figs. 2.7 (a) -(d) that in the SISO case a system satisfying 
the conditions of Theorem 2.3' will automatically have certain guarantee mini- 
mum gain and phase margins if a (i.e. jl+g(s)l ) as a function’ of s £ 
a constant non-zero lower bound, say a^. If then Fig, 2.7(d) shows 

that g(s) must have exactly a oneTpoie roll-off. It is- well-known (see, e.g., 
[-20]) that physical systems always exhibit at least a two-pole roll-off which 
again from Fig. 2.7 (d) Indicates that < 1. 

The case coq > 1 is inconsistent with the assumption that the state-space 
realization of g(s) does not have a feedthrough term. Thus for Oq < 1 exami- 
nation of Fig. 2.7(b) or Figs. 2.7(c) and (d) Indicates the guaranteed gain 
and phase margins. These margins generalize to the multivariable case as 
demonstrated by the following corollary. 

Corollary 2.1: If the conditions of Theorem 2.3 hold for all R sufficiently large 


and 
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a(l+G(s)) s Q (2.36) 

for some constant <1, then simultaneously in each loop of the feedback 
system of Fig. 2.1 there is a guaranteed gain margin (denoted CM) given by 


GM = 


1±a. 


(2.37) 


and also a guaranteed phase margin (denoted PM) given by 

2 


PM = ± cos*^[l - 


a 


0 


] 


(2.38) 


Proof: Appendix 

The interpretation of the gain and phase margin quantities specified in 
Corollary 2.1 require some explanation. First of all, the word "simuitaneousiy" 
in Corollary 2.1, means that the gains or the phases of all the feedback loops, 
may be changed at the same time within the limits prescribed by (2.37) and 
(2.38) without destabilizing the closed-loop system. It does not mean , just as 
it does not in SISO case, that the gains- and phases may be changed simultane- 
ously. Secondly, (2.34) is to be interpreted as meaning any gains, Y. / inserted 
in the feedback loops of the system of Fig. 2.1 satisfying 


1+a„ 


^i < 


1-a„ 


(2.39) 


will not destabilize the closed-loop system. Similarly for (2.35), every loop 

j4>i 

may have a phase factor e inserted provided 

2 

-1 “o 

|<j).| < cos '[1 - -f] 


(2.40) 
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and the system will remain closed-loop stable. 

The ability to consider simultaneous gain or phase variations in all the 
loops of a multivariable feedback system is physically very appealing. A 
typical example Is a flight control system, in which the effectiveness of all 
control surfaces varies simultaneously as a function of altitude and airspeed. 
Another common model uncertainty in flight control applications is a crossfeed 
arising from a neglected interaxis coupling. Bounds on the ability of a 
multivariable system to tolerate crossfeed uncertainty are given in the fol- 
lowing result. 


Corollary 2.2: . Provided the conditions of Theorem 2.3 are satisfied for all 
R sufficiently large and 


a(i+G(s)) > cXq , s G (2,41) 

for some constant <1, then the feedback system of Fig. 2.1 will tolerate 
a crossfeed perturbation of the form 


1,^ X(s) 


0 


L(s) = 


0 1 


or 


m J 

where I. is the kxk Identity and 


X(s) I 


m 


(2.42) 


(J(X(s)) < 


a, 


s G 


(2.43) 


without becoming unstable, that is have no CRHP zeroes. 


Proof: Appendix 
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There is one final result that will be of use to us in the next section. 
This theorem involves the well-known passivity condition [12], [13]. 

Theorem 2.4: The polynomial CRHP zeroes if the following 

conditions hold for all R sufficiently large: 


(a) 

conditions (2, 16)-(2. 18) of Theorem 2.2 hold 

(2.44) 

(b) 

C(s) + C^(s) > 0, s G fip. 

(2.45) 

(c) 

L(s) + L^(s) >0, s G 

(2.46) 


Proof : Appendix 

Just as for Theorem 2.3, specializing to the SISO case illustrates the 
types of G(s) and L(s) that are required as well as the associated guaranteed 
minimum margins. Figs. 2.8{a] and [b] depict the constraints (2. 45) and (2.46) 
in the SISO case and show that since g(s) cannot encircle the "-1" point it 
must be open-loop stable in order to apply the theorem. It Is fairly obvious 
that the phase of g(s)Jl(s) is less than 180® and thus g(s)£{s) # -1 is assured. 
The gain and phase margins are also immediately apparent from Fig. 2.8(a) 
or (b) and again generalize to the multivariable case given in Corollary 2.3. 

Corollary 2.3: If the conditions of Theorem 2.5 hold for all R sufficiently 

large then sii.iuitaneously in each feedback loop of the system of Fig. 2.1 
there is a guaranteed gain margin given by 


CM = 0, +CO 


(2.47) 
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and also a guaranteed phase margin given by 
PM = ±90“ 


(2.48) 


Proof : Appendix 

Corollary 2.4: If the conditions of Theorem 2.4 are satisfied, then the feedback 

system of Fig. 2.1 will tolerate a crossfeed perturbation of the form given in 
(2.42) where 

a(X(s)) < 2 , s ^ ^2.49) 

without becoming unstable, that Is have no CRHP zeroes. 

Proof: Appendix 

Returning to Example 2.1, the nearness to instability can be easily de-’ 
tected using Theorem 2.3. Fig. 2.9 shows a(l+G(j(jD)) as a function of w , 
where b^^ been selected as 50. At low frequencies o(l+G{]w)) is very 
small giving 


CM = .93, 1.08 

(2.50) 

PM = ± 4.1® 

(2.51) 


However, we know by inspection that each feedback loop in the system has 
an actual infinite upward gain margin and a -1 gain reduction margin which 
indicates that (2.50) and (2.51) are very conservative estimates of gain and 
phase margins. Nevertheless, they indicate a robustness problem which is 
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exhibited by the very small crossfeed tolerance 

a(X(s))<min o(!-5-C(s)) = 0.071 = -23dB . (2.52) 

This was precisely the type of perturbation given previously in Fjg. 2.5 to show 
nearness to instability. In general, the type of perturbation that the feed- 
back system is most sensitive to is given by 

L(s) =[I - 2{1 +G(s))u(s)v^{s)]~^ (2.53) 

1 

where u(s) and v(s) are respectively the right and left singular vectors of 
l+G(s) corresponding to o(I+G(s)). This is the perturbation which makes 
I+G(s)L(s) exactly singular with minimum o(GJ[s) - G(s]). 


Vhe right and left singular vectors u(s) and v(s) are respectively unit 
length eigenvectors of (1+G(s) ) (J+G(s)) ^ and (l+G(s))H(H-G(s)) such that 
(1+G(s))v(s) = a(l+G(s))u(s) . 
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lil. LQ AND LOG STABILITY MARGINS 

The subject of qualitative feedback properties of LQ control systems 
is not a new one. An early and fundamental paper by Kalman [21] detailed 
properties shared by all LQ regulators in the SISO case. Kalman showed 
that the return difference transfer function of a SISO LQ state feedback 
regulator satisfies the Inequality 

h+g(jw)j> 1 Vu (3.1) 

which Is both a classical condition for the reduction of sensitivity by feed- 
back (see, e.g., [9]) as well as necessary and sufficient for a (stable) 
state feedback regulator to be optimal with respect to some quadratic 
cost index. By inspection of the Nyquist diagram corresponding to (3.1), 
(Fig. 3.1), it is straightforward to observe [22, pp. 70-76] that a SISO LQ 
state feedback regulator has a guaranteed infinite upward gain margin, at 
least a 50% gain reduction margin and also a guaranteed minimum phase 
margin of ±60®. 

Anderson [23] developed a multivariable version of condition (3.1) as 

a property of LQ state-feedback regulators; a similar generalized condition 

arises in sensitivity theory ^ (see, e.g.,Cruz and Perkins [24]). In the 

remainder of this paper, we will exploit the multivariable form of (3.1) 

together with the results of the proeceeding Section to establish the stability 

margin properties of LQ and LQG optimal regulators. 

_ _ _______ 

Sensitivity refers to the variation In system responses due to infinitesimal 
changes in the nominal system parameters. Robustness refers to the 
delineation of finite regions of allowable variation in nominal system 
parameters that preserve stability. 
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A. Multivariable Kalman Inequality 

We will need a precise statement of the multivaridble version of condition 
(3.1) in the sequel, and this is provided by the following theorem- The 
proof is by straightforward manipulation of the algebraic Riccati equation 
and is included, for completeness, in the appendix. 

For convenience we will assume that in all remaining theorems and 
corollaries that the Nyquist contour is chosen with R sufficiently large 
so that the theorems of Section II may be applied. 


Theorem 3.1 : If K satisfies 

a"’"k + KA + Q - KBR'^b'^^K = 0 (3.2) 

with R >0 and Q > 0 then 

(l+G(s))^R(l+G(s)) = R + H(s) (3.3) 

where 

G(s) = R“^b'^K(1s-A)“^B (3.4) 

H(s) = [(ls-A)“^B]*^(Q + 2Re(s)K)[(Is-A)“^B] . (3.5) 

Furthermore, if Q > 0, B has full rank and K > 0 then (3.3) implies that 

r 

(l+G(s))*^R(l+G(s)) > R, ^ ^ ‘^R 


Alternatively, if det(jti)l-A) 0 V u and K > 0 then (3.3) implies that 
(l+G(s))’^R(l+G(s)) ^R, ®^^R • 


(3.7) 
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Proof : Appendix 

H 

It is important to point out that this theorem uses G (s) rather than 

T 

G (-s) as in [23]. These two quantities are the same when s = jw, but are 
different when Re{s] 4 - 0. This is the case when s is evaluated along the 
Nyquist contour and this contour is indented along the imaginary axis. 

|_j 

It is necessary to use G (s) in order to apply the theorems of Section 1 1 . 
Note, however, that when det(juI-A) # 0, Vw, that is just the imaginary 
axis from -]R to jR. In this case (3.7) could be written as 

(l+G(ja)))’^R(l+G{]a))) > R Vu (3.8) 


which is the previously mentioned multivariable generalization of condition 
(3.1). 


Of course, the Riccati equation (3.2) arises in connection with the LQ 
regulator problem given by 


min J(u) = f x”^(t)Qx(t) + u^(t)Ru(t)dt 
u(t) 


(3.9) 


s.t. x(t) = Ax(t) + Bu(t) 


(3.10) 


which has the usual solution 

u(t) = -R"'‘B’'’K'x(t) (3.11) 

with K > 0 satisfying (3.2) , provided (A,B,Q^^^) is minimal. 


B . Stability Margins of LQ Regulators 

We can now employ Theorem 3.1 in conjunction with the results of 
Section II to establish the robustness properties of multivariable LQ regulators 
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Recall from Section II that the key quantity for multivariable robustness 
analysis is the minimum singular value a (I+G(s)), where G(s) is the 
loop transfer matrix. Unfortunately, the inequalities (3.6) and (3.7) 
of Theorem 3.1 do not provide a bound on a(I+G(s)), where G(s) is 
the LQ regulator loop transfer matrix defined by (3.4). However, if 
we define 

G(s) = R^G(s)R"^ 

then (3.7) (for example) can be rewritten in the form 

(!+G(s))'^(l+G(s)) > I, sGDp,. (3.12) 

Equation (3.12) provides the bound 

a(I+G(s)) ^1, sGRj^ • (3.13) 

on the minimum singular value of i + G(s) . 

A 

To work with G(s) instead of G(s), it is necessary to manipulate Fig. 
2.6 into the equivalent (for stability analysis) form depicted in Fig. 3.2. 
Then using (3.6) and (3.7) together with Theorem 2.3 leads directly to the 
following result. 

Theorem 3.2 : The polynomial $^^(s) has no CRHP zeroes provided the 
following conditions are satisfied: 

(a) conditions (2.16) and (2.17) hold (3.14) 

(b) G(s) is specified by (3.4) where K > 0 satisfies (3.2) (3.15) 

and [A,B] is stablizable/ [A,Q?] is detectable and 

B has full rank. 
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(c) with y(s) = a(R^L ^(s)R *-I) either of the following hold 

(i) Q > 0 and yCs) _< 1, s S (3.16) 

(ii) <f>Q|_(jw) 9 ^ 0 Vw and y(s) <1, s G (3.17) 

Proof ; Appendix 

j. 

Note that the condition a(R^L(s)R ^~l) ^ 1 in (3.16) can be rewritten 
as 

RL(s) + L^(s)R - R ^ 0, s€Qp, (3.18) 

or with s = jo) 

L(io))R‘'^ + R”\^(jw) - R“^ > 0 V CO . (3.19) 

The inequality (3.19) is used by Safonov and Athans [25] to prove the LQ 
state feedback guaranteed gain and phase margins although their method, 
of proof is quite different. They implicity assume that L(jco) is stable, 
something which we do not require. 

Theorem 3.,2 can now be employed to establish the guaranteed minimum 
multivariable gan and phase margins associated with LQ regulators. We 
emphasize that these margins are guaranteed only if R is chosen to be a 
diagonal matrix; we will subsequently present an example showing that the 
margins can be made arbitrarily small for an appropriately chosen non- 
diagonal R matrix. 

Corollary 3.1 : The LQ regulator with loop transfer matrix C(s) satisfying 
(3.13) has simultaneously in each feedback loop a guaranteed minimum 
gain margin (GM) given by 
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GM = 1 « (3.20) 

and also a guaranteed minimum phase margin (PM) 

PM = ±60° (3.21) 

if R is diagonal and either Q > 0 in (3.2) or ^ V u. 


Proof: Appendix 

j <!>: 

If o. represents a pure gain change or a = e represents a pure 
‘ i 

phase change, then Fig. 3.3 illustrates the placement of the cXj in the feed- 
back loop. Note that the interpretation of the gain and phase margins specified 
in (3.20) and (3.21) changes siightiy depending on whether Q > 0 or 

<f>«i (jiij) 0, V(o holds, if Q >0, then the pure gain a. must satisfy ct. > 1/2. 

J4>j 

Similarly, for a. = e we must have |(j). | ^ 60°. If only 0, V w 

holds then pure gains a. must satisfy a. >1/2 while pure. phase factors 

j<i>j ' ‘ 

ct. = e must satisfy |(j).] < 60°, 

Results related to Corollary 3, 1 have been derived by various authors 
[26]-[29j; but the definitive treatment including the multivariable phase 
margin result is due to Safonov and Athans [25]. The approach of this 
paper, based on relatively simple frequency domain arguments, is new. 

If R is not .diagonal then the guarantees of Corollary 3.1 do not apply. 
The following example illustrates that the gain margins may become arbitrarily 
small. 


Example 3. 1 : 

Consider the LQ regulator specified by (3,15) when 


(A,B,Q^) 



1 

0 



1 


(3.22) 
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and R > 0 is a nondiagonai matrix given by 

R = b'^[K^+2K]B , (3.23) 

where K > 0 is arbitrary. By selection of R in (3.23) K satisfies (3.2). Now 
let the multiplicative perturbation L(s) be given by the constant matrix L 
where 


L = 


1 

0 


0 ■ 
1+G 


(3.24) 


and £ # 0 is arbitrary. The zeroes of eigenvalues of the 

perturbed closed-loop system matrix where 


= A-BLB~^(21+K ^) 


(3.25) 


or 



(p^+2) + $ G P2~^ 

n+QP2 


P2 + 6 e (P3+2) 

(i+q(P3+2) - 1 


(3.26) 


where we have let K ^ be denoted by 



(3.27) 


For to have no CRHP eigenvalues it is necessary for tr < 0. How- 
ever, by inspection of (3.26), if p^^O then for any 0 there exists a 3 
that will make tr A^^^ > 0 and therefore for arbitrarily small G, the perturbed 
closed-loop system w4il be un-stabie. 
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The basic problem exposed here is that the margins are really 
guaranteed at a different point in the loop than where we would like. 

This is illustrated In Fig. 3.4 where the perturbation L{s) is inserted at 
point (^. When L(s) is diagonal, as when calculating gain and phase 
margins, and R is also diagonal then R ^ and L(s) commute and points (T) 
and(^ have identical guaranteed gain and phase margins. Point is 
where it is important to have margins (i.e. , at the input to the physical 
plant), not inside the compensator at point (T)* 

Returning to Example 2.1 of the previous section once more, an LQ 
feedback control law is given that has the same closed-loop poles as before, 
but dvoids the near instability associated with the negative identity 
feedback. 


Example 3,2: 

With b ^2 = (2. 10) as in the plot of a(l+G(j w)) in Fig. 2.9, an LQ 

design using R=l and 


Q = 3 


2601 

-50 


-50 

1 


(3.28) 


gives a feedback gain of 


-1 T 

R B ' K = 


1 -50 


0 1 


(3.29) 


and a ciosed-loop system matrix of 
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Acl = a - BR = -21 


(3.30) 


This makes I+G(s) 


I-jC(s) 


s+2 

s+1 



0 


s+2 

S+1 


and thus 


(3.31) 


a(I+G(j to)) 


2 

0) +4 
, 0)^+1 J 


> 1 


(3.32) 


As one might expect the ability of LQ regulators to tolerate crossfeed 
pertrubations is also affected by the choice of the control weighting matrix 
R. This is made precise in the following corollary. 


Corollary 3.2; The LQ regulator with loop transfer matrix G(s) satisfying 
(3.15) will tolerate (i.e., $^j^(s) will have no CRHP zeroes) a crossfeed 
perturbation of the form (2.42) satisfying (2,16) and (2.17) provided 


o ^(X(s) ) < min 


where R is given by 


X . (RJ X , (R^) 
min 1 min 2 


R = 


R. 


X (R.,) ' X (RJ 
max'- 2 max^ r 


s G Q 


R 


(3.33) 


(3.34) 


and is conformably partitioned with L(s) in (2,42) and either Q > 0 or 
<{)Q^(jw) 0 Vo) holds. 


Proof: Appendix 



1/2 


Xmin(R^) AminCR^) 

Amax(R 2 ) ' Xmax{R^) 

which indicates that if the ratio of Xmin(R) /Xmax(R) is very small that the 
ability to tolerate crossfeed perturbations is drastically reduced. As illustrated 
in Fig. 3.4 the use of R scales the inputs and outputs such that the stability 
margins are obtained in the scaled system rather than the original system. 

This means that if our original model has the coordinate system in which we 
would like to guaranteee margins, that R should be selected as R = pi for 
some positive scalar p. 

Since LQ, designs have inherently good margins provided R is selected 
appropriately, it is natural to search for variations of this method. One 
such variation, proposed by Wong and Athans [27], is to solve a Lyapunov 
rather than a Riccati equation to compute K in (3.11). 

The Lyapunov equation with Q 0 given by 

a'^'k + KA + Q = 0 (3.36) 

guarantees that the eigenvalues of A lie in the CLHP if K ^ 0 and [A, 
is detectable. The corresponding Kalman type inequality for loop transfer 
matrices G(s) specified by (3.4) where K ^0 satisfies (3.36) is given by. 

RG(Jw) + G^(j(o )R > 0 , Vo) (3.37) 

and is the fundamental inequality used to derive stability margins. When 
Q > 0 the inequality (3.33) may be changed to strictly greater than. The 
stability margins for this type of feedback are given in the next theorem 


Xmin(R) 

Xmax(R) 


< min 


1 

•Xmin(R) 


Xmax(R) 


(3.35) 
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and Its corollaries. 


Theorem 3.3; For G(s) of the form of (3.4), 
if the following conditions hold: 


♦clIs) 


has no CRHP zeroes 


(a) ^ql(s) has no CRHP zeroes (3.38) 

(b) K ^ 0 satisfies (3.36) with Q ^ 0, R >0 and [A, (3.39) 

detectable , and B has full rank 


(c) either of the following holds 

(I) Q > 0 and RL(s) +L^(s)R>^0, sCJi^^ 

(ii) RL(s) + L^(s)R >0 s G flp. 

Proof: Appendix 


(3.40) 

(3.41) 


Corollary 3.3: For C(s) as in Theorem 3.3 with R diagonal the guaranteed 

gain and phase margins are given by 

CM = 0, «> (3.42) 

and 

PM = ±90® (3.43) 


Proof : Similar to Corollary 2.3 

The importance of Corollary 3.3 is that the standard LQ. guaranteed gain 
reduction margin of y. can be reduced to 0 by using K satisfying the Lyapunov 
equation (3.36) with Q > 0 rather than the Riccati equation (3.2). Of course, 
it is possible to hava a zero gain reduction margin only for open-loop stable 
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systems. However, standard LQ state feedback does not guarantee a zero 
gain reduction margin even in the open-loop stable case, and has been 
criticized on these grounds [20]. Having a zero gain reduction margin Is 
important in situations where actuators may fail or saturate, and there 
is no opportunity to reconfigure the control system. In fact, the moti- 
vation for the thesis [26] (which in turn lead to most of the developments 
reported in this paper) was a study supporting the design of the automatic 
depth-keeping controller for the Trident submarine, in which saturation of 
one of the two actuators produced an unstable closed-loop system. 


Corollary 3.4: For G{s) as in Theorem 3.3 the crossfeed tolerance is given 
by 


a ^{X (s) ) < 4 min 


Amin(Rp 

XmixlR^ 


Amin(R2) 

Amax(R^) 


s € 


R 


(3.44) 


where L(s) is given by (2.42), R > 0 is given by (3.34) and (3,38) holds 
ensuring ?Qj_(s) has no CRHP zeroes. 


Proof; Analogous to Corollary 3.2. 

Another way to modify the LQ design procedure that is a compromise 
between Theorem 3.2 and Theorem 3.3 involves using a parameterized Riccati 
equation given by 

a'**K + KA + Q - BKBR'^b'^K = 0 (3,45) 

where 3 is an adjustable parameter and 0 < 3 < 2, The feedback law is still 
given by (3.11) and G(s) is still given by (3.4) with K ^0. Since the 3 
in (3.45) may be lumped together with the R matrix, (3.45) is just a standard' 
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Riccati equation and therefore has a unique solution K ^ 0 under the 
appropriate assumptions (3.15) , The standard LQ optimal feedback law 
associated with (3.45) is given by 

u(t) = -0R“^B"^Kx{t) . (3.46) 

Instead of (3.46) we will use u(t) = -R ^B*^Kx(t) as in (3.11). Thus de- 
pending on whether 6 > 1 or 6 < 1 we are merely decreasing or increasing, 
respectively, the optimal feedback gain by a scalar factor of 1/3- Also with 
G(s) given by (3.4) the standard LQ loop transfer matrix is simply 3C(s). 

From Theorem 3. 1 we know that if Q > 0 

[1+ G(s)]^ 1 R[! + 3G(s)] >^R, s € (3.47) 

which in the SISO case becomes 

I ^ + g(s) I > ^ / s e (3.48) 

and is illustrated in Fig. 3.5(a). To obtain bounds on L(s) to ensure stability 
we merely work with L(s) and BG(s) and apply Theorem 3.2 for the 
standard LQ regulator problem. Doing this we obtain, in the -SISO case, 
the inequality 

l3^.~^(s)-1 I < 1 , 2 ^ ^R, (3.49) 

illustrated in Fig. 3.5(b). Note that from Fig. 3.5(a) that the critical "-1'* 
point is no longer contained inside the circle if 3_^2 and thus there are 
no guaranteed margins. If 3*>0 the guaranteed minimum margins appraoch those 
of the Lyapunov feedback case. In general, for the multivariable case the 
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guaranteed minimum margins^ again if R is diagonal and Q is positive definite, 
are given by 

GM = BV2, « , 0 < e < 2 (3.50) 

and 

PM = ± cos"^ I , 0<B<2 , (3.5.1) 

These guaranteed margins (when 6 £ 1) can also be obtained by similar but 
distinctly different procedures reported in [30) and [31] which utilize 
standard LQ regulators with vanishingly small control weights. 

C . Stability Margins of LQG Regulators 

A basic limitation associated with the LQ guaranteed stability margins 
is that they are obtained only under the assumption of full state feedback. 
State feedback can never be exactly realized, and often it is impossible or 
too expensive to provide enough sensors to achieve even an approximate 
realization. Thus one is motivated to investigate what guaranteed stability 
margins might be associated with LQG controllers, in which a Kalman filter 
(KF) is used to provide state estimates for feedback. 

Since the Kalman filter is the dual of the LQ regulator, dual robustness 
results are obtainable. They ensure a nondivergent Kalman filter under 
variations in the nominal model parameters of the plant whose state is to 
be estimated. To make the precise connection between the regulator and 
filter problems, consider the linear system 


x(t) = Ax(t) + C(t) 


(3.52) 
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y(t) = Cx(t) + 0(t) (3.53) 

where C(t) and 0(t) are zero mean white noise sources with spectral intensity 
matrices 5 and 0 respectively . We wish to estimate x(t) given y(x), 

-oo < T < t, such that the mean square error is minimized. Under the 
assumption the [A,C] Is detectable, it is well-known that the state estimate 
is specified by 

x(t) = Ax(t) + 2C^0"^v(t) (3.54) 

v(t) = y(t) - Cx(t) (3.55) 

where 

AZ + ZA^ + 5 - ZC^0“^CZ = 0, 2^0. (3.56) 

If we calculate the transfer matrix from v(s) to y(s) = Cx(s) , we find that 

9(s) = [C(!s-A)~''zc'^0~’’]v (s) = F(s)v(s) . (3.57) 

Then, if H >0, F(s) satisfies the dual of (3.6) given by 

(I+F(s))0-(I+F(s))^ >0, s€fi^ (3.58) 

which guarantees the stability of the error dynamics under a range of 
perturbations in F(s). Thus, if F(s) is perturbed to F(s) = F(s)L(s), 
where usual assumptions about G(s) are applied to F(s), the Kalman filter 
will remain nondivergent if 

a( 0"^^\”\s) 0^^^ - 1) < 1, s G 


(3.59) 
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or equivaientiy , 

0L^(s) + L(s)0 - 0>O. (3.60) 

It is now readily apparent that F(s), the loop transfer matrix of the error 
dynamics loop of the Kalman filter, is the dual of G(s)in the LQ regulator 
and has the same guaranteed margins at its input, v(s), for diagonal 0. 

Safonov and Athans [32] have developed these dual results for the 
nondivergence of the extended Kalman filter. Furthermore, they have con- 
sidered the robustness properties of a nonlinear LQG control system formed 
by the cascade of a constant gain extended Kalman filter and the LQ state 
feedback gain. The LQ state feedback gain and the constant gain of the 
extended Kalman filter are computed form the linearized model parameters. 
However, the extended Kalman filter must have the true nonlinear model of 
the plant. In the completely linear case the LQG stability margins are much 
easier to obtain. 

The standard LQG control system block diagram is shown in Fig. 3.6. 
with various points of the loop marked. To determine the robustness of the 
LQG control system we insert perturbations at points and (s) {the input 
and output of the physical plant) and find out how large they can be made 
without destabilizing the closed-loop system. It is therefore convenient to 
calculate the loop transfer matrices at points (T) to . The loop transfer 
matrix at point will denoted T"|^(s) and is calculated breaking the loop 
at point and using it as the Input as well as the output. For the four 
points Indicated in Fig. 3.6 we have 

T.|(s) = G^(^ (s) B (3.61) 

T 2 (s) = G^{(|)"'‘(s) -5- BG^ + G^C)^’’g^C 9 (s)B 


(3.62) 
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73 ( 5 ) = C(j) (s)BC^((f) ''(s) + BG^ + G^C) ^G^ (3.63) 

Tjj(s) = C(?) (s)G^ (3.64) 

where 

Gj, = R ^B^K = regulator gain (3.65) 

G^ = Z C***0 ^ = filter gain (3.66) 

^(s) = (ls-A)“^ (3.67) 


Note that points and have the standard LQ regulator and Kalman 

filter loop transfer matrices respectively. Thus at points and 
(inside the LQG controller) the LQ and KF minimum guaranteed stability 
margins apply. The following theorem is a much simplified version of a 
theorem proved in [32] and gives LQG stability margins at points (J) and 
(the input and output of the physical plant) . 


Theorem 3.4: The LQG feedback control system of Fig. 3.6 is asymptotically 

stable under variations in the open-loop plant G (s) = C(ls-A) ^B if the 

P 

following conditions hold: 


(a) the perturbed open-loop plant G (s) - C(ls-A) ^B is such 

P 


(3.69) 


the det(sl-A) and det(si-A) have the same number of CRHP 
zeroes and if detOw^i-A) = 0 then detOw^i-A) = 0 . 


(b) 

(d) 


[A,B] is stabiiizable, Q> 0 , R>0 and K >0 satisfies (3.2) 
and B has full rank. 


G (s) = G (s)L(s) = N(s)G (s) 
and either 

5(r'/V'(s)R-’/2 


(3.70) 

(3.71) 


- 1 ) < 1 


(3.72) 
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or 

a •©'’^^-1} < I (3.73} 

hold for all s e 52 . 

(ej the LQG controller transfer matrix (s) from the plant output to 
the plant input is given by 

G (s} = G (Is-A + BG + GX)“^G. (3.74) 

c r r f f 

where G^ and G^ respectively satisfy (3.65) and (3.66) . 

Proof: Appendix 

Notice that in (3.71) L(s) represents the same perturbation in G (s) 

P 

at the input to the plant as N(s) represents at the output of the plant and 

that Gp(s) is the same in both cases. Now the basic idea of the proof is 

quite simple. At point (x) we have an LQ state feedback regulator loop 

transfer matrix and the LQ guaranteed margins apply. By moving L[s), 

the perturbation, to point we simply change B in the Kalman filter 

-1 T 

to BL(s) leaving G^ = R B K fixed. This, however, is the same as giving 
the Kalman filter the correct dynamic model of the perturbed open-loop 
system without changing either the filter or the regulator gains. The same 
result follows if we start with a perturbation, N(s), at point , where 
the KF guarantees apply and move it to point changing C to CN(s) . 

Thus the LQ and KF guaranteed stability margins will apply to LQG 
controllers at the input and output of the physical plant but under the 
restrictive assumption that the system model embedded within the Kalman 
filter is always the same as the true system. For the more realistic case 
in which the internal model of the Kalman filter remains unchanged, there are 



-41- 


unfortunately no guarantees, as Doyle has demonstrated vvith a simple 
•eounterexample [ 33] . This counterexample is extreme, but it is possible 
to obtain LQG controllers with inadequate stability margins that look 
quite reasonable In the time domain. Fig. 3.7 shows the Nyquist plot of 
a singie-input design reported in the literature [34]; note that the phase 
margin is less than 10®. 

Fortunately, there are two dual procedures that do not require the 

Kalman filter to have the true system model and that still recover the LQ and 

KF guaranteed minimum margins. These procedures use the asymptotic 

properties of the Kalman filter and LQ regulator (see [ ] this issue) and 

can be used only if the plant is minimum phase. If W is a nonsingular arbitrary 

T T 

matrix, then by selecting H in (3.56) as p BWW B and letting p -?■ « the 
loop transfer matrix T 2 (s) in (3.62) approaches T^(s) of (3.61) if the 
minimum phase assumption holds [35]. Thus the LQ regulator guaranteed 
margins will be recovered at the input to the plant. Kwakernaak [36] proposed 
the dual of the above procedure to obtain low sensitivity feedback systems. 

His procedure makes T 2 (s) of (3.63) approach T^(s) of (3.64) and thus the 
KF guaranteed minimum margins will be recovered at the output of the piant^. 
However, it is not always the case that an LQG controller needs to be 
robustified by these procedures since in some cases the LQG control system 
will have better stability margins than its full state feedback counterpart 
[42]. 


^Dowdle [37] has adpated these procedures for use with minimal order observer 
based compensators and their duals. 
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Even when these procedures are used, the guaranteed stability margins 

apply atthe input o£ output of the physical plant but not necessarily at 

both input and output. It is desirable to have margins at both these 

locations since the pertrubations In G^Cs) are represented as either 

G (s)L{s) or N(s)G (s) and we should not like small perturbations in either 
P P 

input or output to destabilize the system. Margins at both input and output 
can be ensured if the inequalities 


a(l+G^(s)G^(s)) > 1 


(3.75) 


and 


a(i+G (s)G^(s)) > 1 
P ^ 


(3.76) 


both hold. The relationship between these two quantities when Gp(s) 
and G^(s) are square is given by 


^ a(!+G^(s)G^(s)) < a{I+G^(s)G^(s)) < ka (l+G^(s)G^(s)) (3.77) 

i\ o c c pc,* 


where 


min 


a(G (s)) 

■a(Gp(sy) 


a(G^(s)) 


a(G^(s)) 


> 1 , 


(3.78) 


The quantity k is the minimum of the condition numbers of Gp(s) and 
G^(s) with respect to inversion. The proof is accomplished by a simple 
calculation- and is omitted. From (3.77) we conclude that if k is close 
to unity then approximately the same robustness guarantees will apply at 


both input and output. Note that we have no control over Gp(s) so that 
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if G (s)is nearly singular we must design our compensator so. that 
P 

(s)) s a(G (s)). On the other hand, if our plant is well-conditioned 

c — c 

with respect to inversion our compensator G (s) need not be so severely 

o 

constrained^ . allowing more flexibility in achieving performance objectives. 
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IV. SUMMARY AND CONCLUSIONS 


A. Summary 

In this paper we have stressed the importance of the robustness of 
feedback systems with respect to uncertainty in the nominal plant model. 
Arguing from the multivariable Nyquist theorem, it was shown that if the 
return difference matrix 1+G(s) is nearly singular, then there exists a 
small perturbation in G(s) that will destablize the closed-loop system. To 
detect this condition, singular values, familiar from numerical analysis, were 
introduced. In particular oCI+G(sj) measures the nearness to singularity of 
1+G(s). interpreting a(l+G(s)) lead to a direct multivariable generalization 
of the classical notions gain and phase margins. These margins were shown 
to hold simultaneously in ail loops of the feedback system. Also a channel 
crossfeed margin was derived from a(l+G(s)) which is the key quantity in 
the determination of all the stability margin results. 

Direct synthesis procedures involving o(l+G(s)) are unknown at present. 
This is due in part to the complicated dependence of a(l+G(s)) on the com- 
pensator implicit in G(s) . However, the LQ state feedback regulator was 
shown to provide an indirect synthesis procedure which automatically ensures 
a degree of robustness in the coordinate system specified by the control 
weighting matrix R, Thus LQ state feedback is preferable to state feedback 
specified by pole placement techniques since there are no robustness guarantees 
provided by this latter method. Next, using the Lyapunov equation to compute 
the feedback gains, a regulator was specified that was stable in spite of the 
failure of any of its feedback channels. For LQG control systems there are no 



-45- 


automatic guarantees. However, in the case of minimum phase plants, the 
LQ- guaranteed margins are asymptoti'caUy recoverable if necessary. 

Even so, these guarantees will simply be inadequate if excessively 
large feedback gains are used. This is most clear in the SISO case when the 
gain crossover frequency occurs at a frequency at which the phase of the 
open-loop transfer function is completely uncertain. In this case the phase 
margin necessary for stability is ±180° requiring the loop gain to be less 
than 1. 

B . Conclusions and Future Research 

Although the singular value approach is useful in detecting the near 
instability of a control system, it is sometimes unnecessarily conservative. 

This is due to the fact that some of the small perturbations that would 
theoretically destabilize the closed-loop system will never occur in the physical 
system. Nevertheless they are still detected by a small a(l+G(s)). One 
direction for further research is characterization of the robustness of a feedback 
system in which perturbations in certain directions are ruled out as impossi- 
bilities on physical grounds. This points out the fundamental problem of obtaining 
the characterization of the uncertainty associated with a given model. It seems 
that this knowledge can be acquired only by experience with real applications. 

One of the advantages of the singular value approach is that it singles out 
the worst type of perturbations for scrutiny. Another avenue for research 
is, of course, LQG controller design procedures that ensure a minimum size 
for a(l+G(s)) or its complementary quantity a(l+G ^(s)) and yet maintain 
a satisfactory degree of performance. 
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Jn the decade since the promulgation of the LQG methodology [41], 
much has been learned about the pitfalls of its application to practical 
problems, it has been criticized on the grounds that the optimal control 
problem is over specified to the extent that there is only one solution merely 
to be found by the computer [1]. Practice has shown however, that the LQG 
method is not merely a "cookbook" procedure to be used blindly, but one in 
which a fair amount of iteration on the design of a controiier is necessary to 
obtain satisfactory results. Unlike, however, many of the frequency domain 
techniques which reduce a multiloop problem to a series of single loop designs, 
the LQG procedure is inherently a multiloop procedure. It provides a reasonable 
place to start a control system design and when used intelligently should 
provide the designer a good chance of success. . 
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APPENDiX 


A. Proofs for Sections II and 111 

Proof of Theorem 2.2: For all R sufficiently large, Dj^ will enclose all 

ORHP zeroes of both <|)qj^(s) and and by virtue of (2.17) and the 

indentation construction of Dj^ this can be extended to all CRHP zeroes of 
both ^ sufficiently large, Dj^ avoids all 

OLHP zeroes of <j>Qj^{s) , ^qI^(s) and (|i^j^(s) . From Theorem. 2.1 and (2.18) 
we conclude that 


MO, det[l+G(s)3, Dp,) = -P 


(A.1) 


where P is the number of CRHP zeroes and, by (2.16), also of 

Clearly det(l+{ 1-€ )C(s) + £G(s)] is a continuous function of 


G for all s G Dj^ and from (A.l) 


^1^(0, det[l+(l-S)G(s) +GG(s)], Dp,) 


= -P 


(A. 2) 


e=o 


Now suppose that as £ is varied continuously from 0 to 1 that 
t/K0,det[ l+{ 1-€) G(s) + .GC(s)], Dj^) does not remain constant at -P. From the 
Principle of the Argument we know that for some Con [0, 1] the number of 
zeroes minus the number of poles of det [l+{l-£)G(s) + G G(s)] enclosed in 
Dj^ must change. However, since the poles and zeroes are also continuous 
functions of G , it must be that for some G . on [0,1] that they lie on D~ 

(J K 

and thus 


det[l+(l-GQ)G(s) + GqG(s)] = 0 or co (A. 3) 

Condition (2. 19) eliminates the possibility that det[l+(l-GQ)C(s) + GqG(s) 3 
evaluates to zero. Since R is chosen sufficiently large, must avoid all 
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zeros of 4 >q^(s) and 4 >qj_(s) which include the poles of detII+(J~^Q)G(s) + 
Gq6(s)] a_od thus the possibility that det[ 1+C1-€q]'G (s) + GqG(s)] is in- 
finite is also ruled out. This contradicts the assumption that 
^/'tO,det[l+{l-G)G{s) + GG(s), changes as G is varied on [0,1] and there- 
fore it must be that it remains constant for ail £ on [0,1]. However, this 
implies that for G =1 that 


^0, det[l+C(s)], D^) = -P 


and thus by (2.16) and Theorem 2.1, 




has no CRHP zeroes. 


(A. 4) 


Q.E.D. 


Lemma A. 1 : For square matrices G and L det(l+GL) 0 if either of the fol- 
lowing conditions hold: 


(a) 

c^(L ^-i)<a(I+G) 

(A. 5) 

(b) 

G +G ^ 0 and 

(A. 6) 


H 

l+l" > 0 

(A. 7) 


Proof: To prove (a) rewrite l+GL as 

1+GL = [(L"''-l)(N-G)“Vl](I+G)L (A. 8) 

since L and I+G are, by (A. 5), assumed to be nonsingular, l+GL is nonsinguiar 
-1 -1 

if and only if [(L -1)(I+G) +1] is nonsingular. Condition (A. 5) guarantees 

that 
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|!(L ''-Dd-i-G) ^11 2< 1 (A. 9} 

-1 -1 

which ensures that [{L -iHl+G) + !] Is invertible- To prove (b) , suppose, 
contrary to what we wish to prove that 

det(l+GL) = 0 (A. 10) 

Thus 3 a vector Xt^O 3 (I-fGL)x = 0 and hence 

X = -GLx (A. 11) 

Defining z = Lx^ (A, 11) implies ZrO and 

z = -LGz (A. 12) 

Condition (A. 6) and (A. 12) imply 

z^Gz + z^C^z = -z^C*^rL+L^]Cz > 0 (A. 13) 

and since Cz ^ 0 a contradiction to (A. 7) and (A. 10) is obtained. 

Q.E.D. 

Lemma A. 2; If L is a square matrix and ’L(£) = ( 1-€) I + C.L, then for, all G 
on [0,1] the following implications hold: 

(a) a(L”^~!) < a£l a(L~Ve)-l) <a (A. 14) 

(b) a(L“^-i).<a and L+L^ > 0 =^CT(L~^{€)-I)<a 


(A. 15) 
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(c) a{L~''-l)<a and 2(a^-l)02(L-I) > aV(L+L‘^-2l) 

(A. 16) 

a(L"‘’(q-l) <ra 

(d) L+l”^ > 0 L(Q + > 0 (A. 17) 

Proof : For (a) and (b) rewrite a(L ^(€)-I) < a as 

a\^(QL(Q - (L(Q - l)^(L(G)-l) > 0 . (A. 18) 

Expanding the left-hand side of (A. 18) gives 

a^L^(QL(G) - (L(G)-i)’^(L(G)-i) =G^[a^L^L-(L-l)^(L-i)] + 

+ a^(1-Q[(1-G)I + GCL+L^)] . (A. 19) 

By (A. 14) or (A. 15) the first term on the right-hand side of CA.19) is assumed 
to be positive definite. Now with a<1, (A. 14) also gives 

L^+L > I + (l-a^)L^L > 0 CA.20) 

H 

so that (A. 14) or (A. 15) guarantee L+L > 0 which makes the second term on 
the right-hand side.of (A. 19) positive semi-definite. Thus (A. 18) is true 
for ail £ on [0,1] which is equivalent to a(L ^€3-1) < a ■ To prove (c) re- 
write (A. 19) as 

(A. 21) 

a\’^(G)L(€) - (L{G)-i)*^(L(e)-i) = (a^-l)G^(L-]) ^(L-l)+a G[L+L^-2I] + a^l . 
For the right-hand-side of (A. 21) to positive definite, it is sufficient to show 
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that f(G) > 0 where f(Q is given by 


f(Q = - 2(1)C +a^ 


{A. 22) 


and where 


^ = (a^-1)o^{L-i) ■ 

, 2 ,, 

<j)= a cr( — 1) 


(A. 23) 
CA.24) 


Differentiating f(G) to find an G* such that f[G*) is minimum results in 


c± - 

B2 

and 


(A. 25) 


f(G^) = ^ 


(A. 26) 


Thus f(G*) will be positive if 


2q2 ^ ,2 

a 3 >(|) 


(A. 27.) 


or 


2(ct^-1)a^(L-l) > a^o^(L-i-L^-2I) 


(A. 28) 


which proves (C). 

Implication (d) follows trivially by direct substitution. 

Q .E.D . 

Proof of Theorems 2.3 and 2.4: Conditions (2.21) and (2.44) ensure that only 

condition (2.19) of Theorem 2.2 need be verified. Since a[G(s)] and 
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a[G(s)] 0 as js} -^og, det[J+.{ 1-Q G(-s) + G C(s) ] ^ 0 for 

all ts| = R for R sufficiently large. Thus (2.19) need only be checked for 
s € Lemmas A.1 and A. 2 applied at every s guarantee that 

(2.19) holds for s G and thus for s G Dj^. The conditions of Theorem 
2.2 are satisfied and thus ^q|_(s) has no CRHP zeroes. 


Q.E.D. 


Proof of Corollaries 2.1 and 2.3: In Theorems 2.3 and 2.4 take L(s) to be 
a diagonal matrix given by 

L(s) = diag[^, (A. 29) 

which simplifies condition (2.22) and (2.23) to 

ir.^s)-ll<a^ Vi (A. 30) 

and condition (2.46) to 

Re[£.(s)]>0 Vi (A. 31) 

To obtain gain margins', let 

£.(s) =£., Si. real 
then (A. 30) becomes 



I- < 1 — — - 
■I 1-a„ 


(A. 32) 


and (A. 31) becomes 
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> 0 

Similarly^ to obtain phase margins, let 

l.(s) = e , d5.(s) real 

then (A, 30) becomes 

1 _ < C0S({).(S) 

or 

-1 “o 

(f).(s) < cos [ 1 - -J ] 

while (A. 31) becomes 

cos (Pj(s) > 0 
or 

|<t,.(s) < ±90° 


(A. 33) 


(A. 34) 


(A. 35) 


(A. 36) 


(A. 37) 

Q.E.D. 


Proof of Corollaries 2.2 and 2.4; Only conditions (2.22) and (2.46) need 
verification. With L(s) given by (2.42) we have 



and thus 
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a(L ^(s)-l) =cf{X(s))< a <a(l+G(s)) . 

0 - ~ 


(A . 39)- 


Also, 


L(s) + l'^Cs) = 


21 X[s) 

x1[s} 21 


or 


21 X*^(s) 

X(s] 21 


(A. 40] 


so that 


X . (L(s)+L^(s)) > 2 - A 


fO X(s)‘ 


X*^(s3 0 


(A. 41) 


> 2 - -a 


fr 

X(s)-j\ 

\LxH(„ 

0 jI 


= 2 - a(X(s)) > 0 . 


Q.E.D. 


Proof of Theorem 3, 1 : Direct manipulation of (3.2) gives 

(s*1-a’^)K + K(sl-A) - KBR"''b'’''k = (Q + 2Re(s)K) (A. 43) 

where s* denotes the complex conjugate of s. Premuitiplying and postmultiplying 
(A. 42) by [(sl-A) ^B]^ and [(sl-A) respectively we obtain 

RG(s) + G^(s)R + G^(s)RG(s) = H(s) (A. 43) 

Adding R to both sides of (A.43) gives (3.3). Now Q + 2Re(s)K will be positive 
semidefinite for s S Dj^ if Q > 0 and the indentations of are sufficiently 
small or if Re(s) ^ 0, s G which happens if det(jwl-A) ^ 0 Vw. Thus 
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under these conditions H(s) > 0 or H(s3 ^0 respectively for all s 

Q.E.D, 


Proof of Theorem 3.2 : It is well-known that condition (3.15) ensures that 

(|)clCs) has no CRHP zeroes- Defining G(s) - R^^^G(s)R we see that 
G(s) has a state-space relaization (A, BR R and thus its 

open- and closed-loop characteristic polynomials 

identical to those of (A,B,R B K) . Thus any assumptions about $q|_^(s) 
and (|)^|^(s) obviously apply to $q£_{s) and $^j^{s). Similarly, by defining 
L(s] = R^^^L(s)R we may work with G(s) and t,(s) instead of G(s) 
and L{s). The conditions (3.6) and (3.7) of Theorem 3.1 are equivalent 
to o(l+G(s)) > 1 and a(!+G(s)) respectively. The condition (3.16) and 
Theorem 3.1 require that 


ct( 1 \s)-l) < 1 < a(l+G(s)) , sGflj^ (A. 44) 

and by Theorem 2.3 we conclude that CRHP zeroes. Al- 

ternatively condition (3.17) and Theorem 3.1 require that 

a(t~^(s)-i) < 1 < a(l+G(s)) ■ (A. 45) 

which again by Theorem 2.3 means <j)^j^(s) has no CRHP zeroes. 

Q.E.D. 


Proof of Corollary 3. 1 : From Theorem 3.1 and 3.2 we know if Q > 0 then 


a(R^^V^(s)R = o(L ^s)-l) < 1, 


s C 


R 


(A. 46) 


to satisfy (3.16) when L(s) and R are diagonal. If 0 Vw then 

S C 


a(L'’’(s)-l) < 1 , 


^R 


(A. 47) 
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to satisfy (3.17) when L(s) and R are diagonal. The remainder of the 
proof is completely analogous to Coroilafy 2.1 

Q.E.D. 


proof of Corollary 3.2 : Only conditions (3.16) and (3.17) of Theorem 3.2 
need to be verified for the L(s) of (2.42) the rest are satisfied by assumption. 

^ i 

Note that for s G 


a(R^^\ ^(s)R ^^^-1) = a 


0 -Ry^X(s)R2^^^ 


0 0 


or 


ro 


a 


[-R2'^^X(s)R^^^^ 


(A. 48) 


and hence if 


< a(X(s)) max{a(Rj^^)a(R 2 ^^^). a(R 2 ^^) ^ } 


a(X(s)) max 




A (R^^) 
max 2 


A . (R^^) 
mm ^ 1 


< 1 


(A. 49) 


then conditions (3.16) and (3.17) are both satisified. However, (A. 49) is 
equivalent to (3.33). 

Q.E.D. 

Proof of Theorem 3. 3: Conditions (3.38) and (3.39) and the Lyapunov 


stability criterion guarantee that condition (2.44) of Theorem 2.4 is satisfied. 
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'' 1/2 - 1/2 

As in the proof of Theorem 3.2 we may work with G(s} = R G{s)R 
and L(s] =R^'^^L(s)R instead of G(sJ and L(s) . Condition (3.37) 

A 

is simply condition (2.45) of Theorem 2.4 with G(s) replacing G(s) and 
L{s.) replacing L{s) in (2.46) is simply (3.41). Thus by Theorem 2.4 the 
theorem is proved when (3.41) holds. When Q > 0 and (3.40) is satisfied, 
the strictness of the inequality (2.46) of Theorem 2.4 may be changed to 
^and the of (2.45) to > and Theorem 2.4 remains valid. Thus when (3.40) 
holds Theorem 3.1 is again proved. 

Q . E . D . 

Proof of Theorem 3 .4: Breaking the loop at point CD Fig- 3.6 we have a 
loop transfer function matrix of 

G^.(sl-A+G^C)”^[G^C(Is-A)“^B -i- B] = Gj.(sI-A)”'’b = G(s) (A. 50) 

so that 

(j)oL(s) = det[sl-A + G^C] det[sl-A] (A.^1) 

and 

$0|_(s) = det(sl-A + G^C] det[sl-A] (A. 52) 

Since the Kalman filter error dynamics are stable given (3.70) and since 

(3.68) holds, conditions (2.16) and (2.17) of Theorem 2.2 hold. Now by 

direct application of Theorem 3.2 we conclude that the system of Fig. 3.5 

is stable if L(s) is inserted at point CD • However, this is not the location 

we desire to have the margins guaranteed. Nevertheless, by manipulation of 

the block diagram of Fig. 3.6 we may place L(s) at point (D) if we change B to BL(s). 
. -1 T 

inside the controller leaving G^~ R B K fixed. This, however, is equivalent 
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to changing (A,B,C) to (A,B,C) inside the controller leaving and 
fixed which Is the desired result for perturbation L(s) . The proof for a 
perturbation N{s) at the output is analogous. 

Q.E.D. 


B. Singular Values [19], [38] - [40] 

The singular values of a square nxn complex matrix A, denoted o.(A), 
are defined as 

a(A) = A. (A A) = Xj (AA ) (B,1) 

H H 

where A denotes the complex conjugate transpose of A and X.{A A) the 

th H 

i ■ largest eigenvalue of A A. A way of representing the matrix A, known 
as the singular value decomposition (SVD) is given by 

A = 2 aCAju-vf (B.2) 

i=l ‘ ‘ ‘ 

where 


[ U.J / U2 / • • • / 


= 1 

(B.3) 


V ] ; 

< 

< 

11 

(B.4) 

-n 



diag[a^, 0 ^, 



(B.5) 


H H 

and the columns of V and U are eigenvectors of A A and AA respectively- 
The minimum and maximum singular values denoted a and a respectively are 
sometimes equivalently defined in terms of the spectral matrix norm j j • j I 2 ss 
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- ■ M 

a{A) = max -r™ — = j |A; ; (B.63 

and 

■ 

1 |Ax I j I [A~^ j I~\ if det A^O 

£{A) = min — r-| — j-i — = . (B,7) 

I |xl l 2#0 - I 1^1 '2 0 . if det A=0 

■ 

The minimum singular value a(AJ provides a measure of the nearness to 
singularity of the matrix A in the following sense, if A+E is singular then 

I |E| I 2 = a(E) > £(A) . (B.8) 

Other facts involving singular values that are useful for mani- 
pulation follow. The inequality 

a(A} > 0(B) (B.9) 

(B.10) 

(B.n) 


may also be written 
A^A > B^B 

Also^since a( 0 is the same as | [*| I 2 / triangle inequality 
o(A+B) < a(A) + o(B) 

holds. Finally, if A ^ exists then (B.6) and (B.7) give 

I 

aCA 


(B.12) 
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Fig. 2.1; Feedback system where G{s) represents 
the open-loop plant plus a compensator. 
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Fig. 2.6; Feedback system with multiplicative 

representation of uncertainty in G(s). 
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Frequency (rad/sec) 


Fig. 2.9: Singular value plot of £(1+G{j w)) 
for Example 2,1 when ~ 




Fig- 3.2: Feedback system for stability margin 
derivation {compare Fig- 2.6). 







Fig. 3.3: Configuration for definition of multiloop LQ stability margins. 
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Fig. 3.4; LQ regulator with margins guaranteed at point G) 
for an R>0 and at both ^ and (^for diagonal 
R > 0. ' 
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F5g. 3.7: Nyquist diagram for LQG design in [34].. 
(H(jcu] = loop transfer function). 


